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A summary of an extensive literature^^i^vey deals 
witk the variables known or suspected to affect the; retention of 
learned motor behaviors over lengthy no- practice intervals. jSmphasis 
was given to research conductejd by or fpr the Bilitary* The variiaibles 
that may affect the retention ,bf motor skills were dichotomized into 
'^sk variables and procedural .variables. The- task variables that: may 
underlie the long-term retention of motor skill include (1) duration 
of the no-practice period, or\l retention interval; (2) nature of the 
xesponse require accomplish a particular motor task; (3) degree i 
|to which the lea can orga&;Lze or impose order upon the elements I 
that define the task; (4) sti^ucture of the t^raining environment; knd 
i(5) ;;iriitial or "natural" abij/i-^y of the learner in "performance of a | 
rtask without {)fior practice. |Thd procedviral variables that may affect 
il:he ;lbhg-term. retention of mj©tor\skill include (11 degree of ; ' 

;prbticiency attained by the learner .during initial training; (2) 
iambufl^ traiiiing; (3) transfer of skills on one! 

^taisk; to perform on another/ task; (4) presence of interfering ' ! 
iactivities; (5) distribution' of practice during training; (6) use of 
;part-task versus whole- t^ training methods; and (7) introduction oi 
jextra/'test trials prior to fihal testing^ (Author/CSS) '-'V 
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; . ; ; : RETENTION OF ' MOTOR ' SKILLS s REVIEW 



BRIEF 



- A^-part of a inajor program on individual training for combat readi- 
inkss/ to develop -a sound information base for Army decisions necessary 
^tp ihstire; soldiers V long- ^ proficiency, this review focuses on 

iiretentidn o^^ nrator skills . ^ 



; .Procedure t 

^ ;^^ ^TiliSo review is based upon a wide variety of data from an extensive 
' aiiteiratufe survey of pertinent research. - Although military-related 
■findings were incoirporated wherever possible, some of the; experiments 
^ citfid u^ed tasks having 1 ittle" direct or obvious relationship with 
i skills currently maintained within the Atmy . In addition , ; oonf licting 
> data i and data pertinent to a more detailed understanding of the behav- 
" lorai^ cbnsequences of an extended no-practice period generally were 
iskitnined over Jto lend coherence to this report-. In so doing, an overs im- 
Iplified : picture of long-term motor memory and the variables that may 
: affect it has been sketched. These constraints notwithstatiding , a num- 
ber of tentative conclusions have empirical support. 
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'Findings: 



' ; ; : 1 : 1. iThe single most' important determinant of /motor retention: is 
ieyel of original learning. , Knowledge of results ; and response-produced • 
i fe^dijack ■ are thought * to contribute most to a trainee,' s ; original learning. 
Effectiveness of the knowledge of results increases with its availabil- 
'■■ ity and precision . Effectiveness of response-produced feedback increases 
I with .its : (luahtity , for example number of feedback channels and ; amount of 
ipractice,' and fidelity. . ^ 

i ■ 2 . Procedural tasks are forgotten in days, weeks , or months, 
; whereas continuous control tasks typically are remembered for months or 
years'. , ; : ' - — ' "'' . : ^ - ■ ': 

M; :;- 3. Retention of skill deci^ases with time, depending on a host of 
i variables, including the lenith of the no,-practice period, \the type of 
; ;task^^ ikna;. the practice or ' int^i^f ering activities before or 'during the 
: ireteritioh : interval - /. :■[':/' ■ ■ / l\ I 



4. Retention is improved by increasing the amount of original prac- 
tice. Overtraining or mastery training may be more cost effective than 
proficiency training, that is^ training to one successful performance. 

^. 5/ - Time to ret^rain individuals to original performance levels is 
generally rapid, consistently less than half the original training time. 

6, Learners apparently can impose organization upon psychologically 
■unstructured tasks via the learning process- As a result, task structure 
is not an important variable for the long-'term retention of well-learned 
responses, although' it is an important variable for the retention of less 
well-learned responses. ^ 

7: Functional similarity of the training device to the actual 
-equipment is a necessary and sufficient condition for. learning ^procedural 
'tasks . . ; ' 

\ * . ■ ■ , .^"'^ 

8.. Display-control relationships can influence the ease of motor 
learning and transfer and, to some degree, the quality of performance ^ 
after a retention interval • 

.9. Augmented feedback can enhance performance by raising motivation 
learning, or both, 

10. Individual ability levels are important as determinants of 
retention insofar as they influence a person's time to achieve a standard 
level of performance » Individuals of higher initial ability. tend to 
achieve higher levels of proficiency and retain skill at a higher level 
than individuals , of lower initial ability. " / 

11. Refresher, training can serve as an effective source of new 
learning as well as a means for reestablishing forgotten responses* It - 
also ; may provide a relatively simple means of improving on-^the-^ob 
safety and performance. ' 

12 . Learning and reten^iion are benefited by test-taking 
opportunities. / / 
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13. Positive 'transfer effects typically are ^observed when transfer- 
ring between motor tasks. Although negative transfer is the exception, 
occasional ihtruS{ive wrong responses induced by past learning^ may have 
serious consequences for 9perators or equipment. \ 

Utilization of Findings: 

./ The conclusions and implica.tions of previous research provide a firm 
'basis for specific, ongoing programs to develop procedures that the Army 
can use to insure that its -perisonnel remain job proficient over prolonged 
periods... ■ ■ 
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^i.; RETENTION OP MOTOR SKILLS ; REVIEW 



INTRDOUGTION 

The mission of the U.S* Army during peacetime is to maintain a state 
of readiness to fight and to win the first land battle in event of War 
(3a)>* ico accomplish tdi: :^ missiion. Army personnel must be equipped with 

at^-of-the-art weaponry and kept proficient in its use^ Opporiun 
for sufficient post-nvobilization training after the onset of war aire not 
expected. ■ ■ "^-c " 

■",,#>■* " ■ ' " 

Establishing; training procedures to develop proficient trainees is 
one problem; providing guidelines to maintain each individual's prof i--. , 
ciency is another- These problems are interrelated and magnified by a 
resourc0*fconstrained environment. Cost-effective training demands that 
the Army identify procedures that enhance proficiency and minimiise an in- 
dividual's requirement for "refresher" training • 

■ ' . " ' . - ' "( ■• ■ ■ 

\ Purpose and Scope 

T^his review seeks to develop a sound information base to facilitate 
Army decisions about training/ transferring, and maintaining (i.e. , long- 
term retention} skills that ar!e_ critical for combat readiness* An infor- 
matioff^ase ti^ould allow .the Army to (a) develop prbciSdures to maintiain an 
individual *s prof iciency\>v^er prolonged no-practice periods, for. example, 
weeks, months \ or years; and (b) establish mote accurately the optimal" 
intervals for \many refresher training programs,. 

Th6 focus\ of this ^review is on the long-term retention of motor be- 
haviors because well-learned, well-maiijitained motor behaviors (such ap \ 
those in^rolved in operating a tank, piloting an aircraft , si>oo ting a 
rifle, or launching a missile) are necessary to achieve a guaranteed- . 
effective .retaliatory strike force. Of course, the findings are equally 
^^^ertinent to lj:he\^ retention of less dramatic skills that are ju^^as itft- 
portant for maintaining an effective Army. 

\ A pproach . ^ 

' \ ^ ■- ■ ■ i * ■ : 

This report presents a summary of an extensive literature survey 
dealing with the variables known or s\ispected to affeet-.the r^tentiorr^f 
learned motor behaviors over lengthy no-p^^^actice intervals . The survey 
was accomplished using major documentation sources (i*e.. Defense 



jers in parenthesis refer to specific report citations in the 
References section. 



•: -.. ■ . • : .- ■■■ ■ ■ . . ■ ■ ■ 

Dpcuntehtation Center, Human Resources Research Orgfinization: library; ? 
National Technical In fbrr^ Service), data bases (Automated Data pi;\ 
Instructional Technology, Educational Resources ; Information Center^^ ^ ' 
PsychQlbgical Abstracts)^ and a followup search of the psychologicaLir 
milita'ry, and business/industrialvliteratures . * 

Research' conducted by or for the military using military, personn^J. 
as experiroental participants was emphasized. Special consideration w^^ 
given to research, that employed evidently military-relevant tasks 
search oi\ tasks having- ^fewL r.eal^world applications was included only if 
the results weire practically indicative or suggestive. 



RETENTION OF MOTOR SKILL: REVIEW ^» 

T^ie variables,, that may affect the Iqng-tesrm retention of skilled 
mo tor performances were dichotomized into- task variables and procedur^jL < 
variables. Task variables relate to the trainee or to the training/t^^i^t 
envirc^nment ^ whereas procedural variables relate to the manner in whii^fi 
trainingr final testing ^ pr both o'ccur.. Conclusions drawn about each A^^e 
underscored in the te^t, with important reservations and exceptions noted. 
Directions for future research are suggested' where the literature rel^ti^hg 
to the effect of a particular expj^rimental manipulation is ainbiguo^is, 

\ The task variables that may underlie the lohg-term lietentiori of ujptor 
skill include ta) duration of th^ jno-practice period) or [retention inter- 
val; (b) nature of the resppnse required to accomplish a |particuia motor; 
task; (c) degree to which the learner can organize or\ impose border upof» 
the elements that define tlie task? (d) structure of tl^e training envi:ton-;,^ 
ment? andP(e) initial or "natural" eJbility of, the leaj^ner to i>erform ^ ^ 



leaii^ner 



task in the absence of 'prior practice. 

The. prbceduraT variables that may affect the lohg-term retention pf 
motor skill iriclude (a) degree of proficiency attaift^d.lby th^ ^ 
during initiaixtrrining; (b) amount and kipd of refresher training; 
(o) transfer of skills from one task to another task; (d) interfering ^ 
activities) (e) schfediiling Of practice during training; (f) use of par^*- 
task versus whole^-t'^sK training methods; and (g) intrbduction of extr^ 
test trials prior to f^nal testing. " . ^ 

: . ' ' \ ' . • ■ : ^ ' . ■ • 

V^y Task Va^riables ... - . ; ^ 

Retention Interval \ ■ 

.1 ■ ' ^ ■ ' ' 

The retention interval is the pea^iod of no practice between the 
acguisition and subsequent test of a performance. The classical curvg^oj 
forgetting, as depicted in Figure 1/ is believed to apply to motor 
responses . ' , * ^ > ^ 



/ ■■ 



- Note that: the absoXute amount forgotten increases -with time/ whereas 

. \ the apparent rate of forgetting declines-with time. Of course^ the exact 
cr.V^ape of any forgetting curve depends upon a host of variables (21) in-- 

cl^iding (a) the amount of practice the learner receives (48,72) ; (b) the 
' , 3^4ngth**^fHfe^ interval between .training and retention measurement (129); 
,tc) the hatur^s^f the response to be retained (14) ; and (d) activities 
/ that interfere .with acquisition or retention (75). v[ 

Nature of the Response 

Motor r&sponses are classified typically as either continuous ^r 
• discrete, but probably no response is" totally one or the other. We will 
define a response as), continuous if it involves the repetition of amove- 
ment patterh that does not have a discernible beginning or end. ; The most 
commonly employed continuous task in studies of inotor inemory is *trackirig, 
j^res>jucnably because it is the response activity that underlies vehicular 
control (2)x: 7' ^ ^ / . 

/ ■ ■ " , , . ■ , ■" . , ■ 

^There are two types of tracking tasks, pursuit tracking and compen- 
satoiy trackingl In pursuit trjacking, the operator can see both the tar- 
"get^to be followed and his* tracking device or -cursor. The operator's job 
to keep the cursor aligned with the target so that the: discrepancy be- 
; /tween the two, is nullifiec^. Keeping a weapon sight (cursor) on a moving 
.'tank (target).' is an example of a pursuit tracking task. In compensatory 
' tracking, on the other hand, neither the target nor its position is dis- 
. /played. The operator knows only the difference between an error- 
indicator and a fixed reference, and his task is to nullify this . 
'difference. ^ ^ 

\ For example, error:-nullifying ^principles 'are the basis of certain - 
: I^avigational^instraments that si the ' operator to begin directional 

(Or attitludilnal) . corrections if he strays of f the intended, course . Also, 
• , the "leveling vials" used in field artillery may be regarded as a kind of 
. compensatory tracking device.' By compensating for the movenient of an air 
'bubble (error-indicator) floating! within a glass tube mounted ' on the ar- 
tillery, piece, the gunner can adjust the artillery piece to a horizontal 
plane . - . . - \\^ 

h response is discrete if it has a definite beginning and end and, 
typically/ is quite brief in dyiration, for exam^sle, less than 5 seconds 
(117). Familiar examples of discrete responses include moving a gear- 
. shift, shooting a rifle/or throwing a hand grena^le . procedural tasks 
typically are composed of a series of discrete motor responses- Usually, 
, the learner's main problem on each trial -Is selecting the correct response 
from a repertoire^ of possible responses rather than actually executing the 
response- The learner 's /main problem is determining "what to do" rather 
than learning "how to dd it," for example, reassembling a carburetor or ■ 
operating a' radio communications system. 
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This need npt always be the case/ however, because certain proce- 
dural tasks such as playing the piano or executing the Manual of Arms 
not only require the performer to le^rn to select an appropriate series 
of ^ responses jS'ut to learn, how to execute them with the proper: force and 
in\the proper time sequence as well. 

■ Procedural tasks and individual discrete motor responses We for- 
gotten oyer retention intervals: measuried in terms of days, weel^s, or 
months, wjhereas continuous movemencs typically show li ttle or no fdr- 
geteting bVef retention intervals measured in terms of months or years . 
Although ^upport for this proposition has been obtained in a wide vari- 
ety : of basic ( 12^) and applied research settirigs , the most notable; con^ 
tribution^ have [been made by investigators concerned with the long-term 
retentio>i of piloting skills (51,99,100,127) . Studies dealing ..with the ^ 
maintenance of instrument flying skills (9,87) , manned spacecraft flight 
operations (123,124,125) , and lunar landing skills (38) consistently 
indicate that important procedural aspects of flight ..control deteriorate 
to: unacceptable or unsafe levels over ■ retention intervals measured in 
terms of i weeks or mpnths . . ■ 

■ Although data are lacking with respect to the maintenance, of Army 
job-relevant proceduWs , data on the maintenance of basic combatL^tra^n^ 
ing skills (83/141), the preparation and firing of a Nike-Hercules mis- 
sile (54,55), and gunnery prof iciency . in a combat air force. (World war II) 
(114) support the contention that procedural proficiency .c annot be maLin-"*^ 
tained in the absence of regular practice . 

Data on the retention of continuous movements c^^ of 
pursuit tracking (19.,64, 71, 103,115 a26J^,rrc6m^^ trabking (9,14, 

18/48, 87J.., and balancing (88,101, 109 , 115). v In contrast to the findings 
for procedural " tasks , crontinuous movements generally are r etained well 
over prolonged retention intervals , even in the absence of practice . - 
For example, researchers, using a part-task flight simulat:or, found, a 
95% loss of procedural response proficiency over a lO-month retenti^rti 
intea^val, but *found no effect upon the retention of continuous flight 
control responses (9). Others concluded that ^ although the forgetting. of 
cockpit procedures over a 4-month retention interval could impair a pi- 
lot's flying efficiency and safety, this interval wa^s not sufficient to 
degrade. a pilot ' s continuous motor aircraft-control skills (87). 

A number of hypotheses have been offered to account for the differ- 
ence; in retention of procedural and continuous movement tasks (2,92,129). 
They " are as follows : , 

1. The verbal-cognitive nature of procedural tasks may make them 
easier to forget than continuous motor responses. 

2. It is unclear what constitutes an individual trial during a 
continuous performance and, as a result, continuous responses 
may be overlearned and thus retained better than discrete motor 
responses. " 



. Continuous' responses i^iay be : retained better simply because they 
aire fnore integraited or coherent than pre jedural tasks • ; 



4. Retention 
way 



errors 
retention 
sensitive 



differences between tasks may be partially due to the 
are scored, that £s>:. the methods used to score: tti^ • 
of discrete motor respbnses may he relatively more ; 
to slight jierf ormaince deviations than ; the > me'thods ; used 



to ihd^x the retention of continuouis ; respbnses; 

li ' UU ■ Regardless of which interpretation f iri^s [ support; tlie bbsefyatioh^ : • ■ | [ 
• ; thit iprpc are less : likely to; be retained at; an ; aciseptab [[■'{.]'■ 

• iieyelv bv^r a ; rete^ interval than are continuQ\is^iaspons^ implir! ; 

1 [cation ^ZUlTayi ;training, *; In particular/ regular ^6 fie sHer; training. ; l\ 

\ j iimst; |l3e^ tasks that emphasize procedur;ai ? knbwl^^ge . ; ^Ap'sp.mi'- . ; 

• i?ir rxecbnunenda^ was -made to the Navy after a; study; was ; coriduc tela | on 
! ' forgetting; of procedural and continuous instrument flying behaviors ;(87) . ; J 
1^ ^Eortunately procedural tasks are typically les^ expensiv^ land; simplfer to 
:tr^ih: t^ are continuous responses because procedural tasks require lit- 
tle in terms of ; equipment beyond simple classroom trairling aids n(54;S5) 
iilso, it is known that verbal cues and written 30b ! a,ids ca.n facilitate^; ^ 
: ; ^tdie = trai ^maintenance of procfedural tasks ; 81) . Techjiiques ; 

based upon this - observation: currently enhance on-the- job perfpincriamre in 
the :ArTny ( the Ij^egrated Technical Documentatibn and Training ; Program) . 
Research efforts^o make written job aids more accessible aind easier to; 
tmderstand are likely to yield additionAl performance belief its . 



i Organization 

Organization refers to the process; by which the learner 1^ 
order orl .stinacture upon the elements that define his taski by : establish- 

■ ing ; consistent relations among them^ (52) / Evidence,; within the verbal ; ; 
^ ti37) ■ and motor (98,131, 134, 135): memory llteratnijres ? sugges ts j that tasks. 

■ inherently amenable- to ^.earner organization are learned at: .a : faster \ rate 
than ;less: structured tasks . Under conditions of moderate leairning,; highly 

■ structured tasks also are retained : at a higher level than less ; structured 
i HEasks. Once learning reaches an^ advanced stage, however, individuals 

apparently can retain less structured tasks as proficiently as highly 
; structured , ones. ,^ : ^ ^ 

For example, grouE)s of - ihdividiicils in one study were trained to per- 
form two ' tasks simultaneously • The primary task was cbmpensatory track- 
'ing; and the secondary task involved learning either af highly structured 
br! less structured procedural sequence . Training was /conducted for ei- 
ther 2 or 3 weeks artd was followed by retention ^.testihg after either 1 o 
4 \ weeks:. As prfedict!fed, retention of the primary and ^secondary tasks by : 
; groups having the highly structured secondary task was . superior to that 
^ of i groups having the less structured secondary tasH^/ This effect, ^ 
tiowe-^r^rv held only for those groups receiving modej^e amounts of train- 
ing!; Tlies the secondary task .did not affect the loss of 
tracking or procedural proficiency under greater amounts of training (94) . 



i: ERIC 



Thus/ individuals apparently can impose structure upon psychplog- 
ically unstructured tasks by organizing, but the act of organization^ 
takes time and practice. Indeed, the amount, of time and practice re- 
quired for a learner to organize soine tasks may be. too long for any 
reasonable training period. If sufficient initial learning opportuni- 
ties exist, however , less structured tasks can be retained as well as 
highly structured ones . 



^ v.. 



• Training Environment ^ ' 

- i^ variables have been identified (51) that • 

xnay affect the long-term retention of military-related tasks. Among the 
; var'iables are : (a) the: fidelity of training devices; (b) the compatibility 
^ of .display-control relationiships , (c) the^ specif icity' of task displays; . 
and augmented feedback . ^ 1 ' 

Fidelity. The. similarity between training devices and operational 
. equipment can be viewed from two perspectives : physical similarity and 
.functional similarity. Physical similarity, or fidelity , refers to the 
physical resemblance, in an engineering sense, between the. displays ^nd 
controls on a training device and thbse on the operational eqx^ipment.; ^ 
Functional similarity, on the other hand) refers to the "degree of repre- 
sentativeness" or "psychological realism" of a training device relative ^ 
to the actual equipment (145) . 

; Funetional similarity is a necessary and sufficient condition for 
learning procedural tasks . For illustration, the acquisition and long- 
term' retention of a 92-step procedural task "(firing a Nike-Hercules 
missile) following training on a high- functional similarity drawing of 
.the operational equipment has, been shown to equal, learning ai;id retention 
following training on the actual equipment (54 , 55-) . A similar result 
v?as obtained using a complex procedural communicatfion task (20). A 
comprehensive overview of the variables influencing transfer from train- 
ing device to operational setting has been provided elsewhere (144,145);. 

Display-Control Compatibility . Certain display-control relation- 
ships appear -to be more "natural" or "expected" for the human operator, . 
than' others. This notion is based upon the observation that when several 
display-control relationships are possible 'for a given eye-hand coordina- 
tion task, one relationship will lead to subsj:antially better initial^ • 
performance* than the others (46). The interpretations offered for this 
effect suggest. that compatible display-control relationships are more 
consistent with the learners' pasf ^experiences with the environment 
(1,120) or' perhajps more consistent with the principles of human biome- 
chanics than incompatible display-control relationships. 
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j ! Exan\p]jes^ of display-control relationships that typify; those normally 
^ncbuntered in] ;the environment include (a ) ntavihg a pointeir to ■ the rlghp .] 
(display) :!i)y;i^ 

to the right; by • icotating a knob . in a clockwise direction ; and (c) v> moying 
a! pointer dbwrwa^ moving a lever forward : CaiS) - i : \ [ 

The' 'cbmpatibility' of display-control relationships influences the v: 
[ease ^ of motor ^ learning and transfer (1 , 29 ,46) as well as ,the quality ': of: , 
' per fbrmarice after i a^ retention interval (86) > TTiese resul.ts have^^'implica-: : | r 
itions for ; triainihg and equipment: design . . Individuals^: training on higlvf j ■ : j. i 
^bmpatilDiii requirie less^ training tb achieve; ;arid^^ to 

4^ 5 sat isf actoiry level of performance than individuals tirainihg on :;equipmen^ 
haying ;ihcon)patibie; display-control relationships - : i \ : i s ; H 

M • : irici^ed^ it is suggested that; the- performance of indiyidua,:Ls J af forcied ; : |' ^ 
; a! reaspn^le amount pf trairiing on equipment halving; i ^ Aji- 

control: relationships may never catch up to^ the ^ peffoiniiarice; of | i I ; ■ 

iasing high-compatibility equipment p(46) . The coitipatibii^^ display- j l Ti^^^^^ 

ccjjitrol r;ela€ionships may not pose serious problems during the ; performance; 
ot slow, self -paced tasks that allow a liberal; margin for errdi: J But it; : ; p 
would be a mistake to expect optimal performance; using equipment . with in- 
compatible display-control relationships in potentiaily dangerous (120) • \ 
externally paced/ or infrequently performed tasks . 

Specificity of Task Displays , : Most tasks , such as tracking, depend ^ 
heavily upon the processing of visual information from* a task display. 
At least during the initigii: stages of learning, the .learner is forced to 
rely upon the visual cues he rebeives from the task display/ to guide^.his ; - 
performance. Later in learning, however, the learner. relies more oh 
pribceptlve or other internal.^ sources of inf oinmation and depends: less on 
thte display and other external cues (16,49) . This sugge^s visual " 

cues designed to supplement the information provgided by the task idisplay 



are inforifiative early in learning and facilitate the learning process, 
but may be relatively uninformative once the learner has "internalized* 
the performance . This, hypothesis was tested using a: pursuit tracking, task 
and task displays that Varied in. "specificity Display specificity in- 
volved a numerical cc^e and/or. several grid systems that, superimposed on 
the face of an oscillosc'opeV permitted several levels of target-location 
cueing (136.) . ^ . : , * / • ' 

As predicted, the early acquisition of the tracking task was facili- 
tated under, conditions of high-display specif icity. However, the speci- 
ficity of the display^ did not affect the final levels of skill attained 
by the learners nor the 1-month retention. Apparently, later in le arning, 
> supplementary cues from .a display do not provide information over-^and 
above that which is already provided by- qnternal sources and consequently 
are not important as determiners of retention. 
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j'i! ki^ Aug^neivt^dlEeeaback: : Inf ormatioh ; about ; a response : inay; . augmented/ ; i 

rorl ^vippletne^^ :by ae3.iyerihg ; general -instructions or perceptual ; cutes to: 
S^fi^j-Hf "^ritraxn^ aft^r; ithe; :r(Bsp6riSev r'-^For :-exarai?le., y^fi'l^rryr 

!^iUki1^^;^^Minee^Jcah^;seeJ■e^ :he : scores- ; "a: :hit" ; oh - the : standard ; tasky ■ tlten:; : :. .: 

W) kn^a^aMgn^tKitv :or; flashing a light augfnents ^eedback. Little has been , dpne" 
1; 'l:t!.'-i;Ht6 j: k^jse^^ ; directly! itiie eftectsi of : augmented: f eedback; on ; the ^long-termi^y; . 
j:!^KH'i''-5r^t^AtibnJ.pfU /re^ons^s.- i l-The -bnly : expe^iment^fpund 'op; the^^ub^ecty . 

;l:;£^ile^; tbi find ahy i effect of supplementary auditory noisp lappn - the , acqui- 
i -i I'l^ii^^^i ]cyj.\ r^teritibn; 'of ! a : cbmpensatbr^; -tracking \ task =.;(;33.;i v' . ; [ | ,■■ ■ ^ . j-j,' : ^.^ 

njJl-itiiej^xtr^^'ifefetec^ Tis: -jiresent ; and iin ^ tests ' atter^^it ' has i-been^iremoyedh^ 
s'j !:Frii!l vm^ASugme!nt^^ i'ife^dbabkiisj present,: it often facilitates perfotiriance: dur- 
iH^i ^ 'i Thj: tifaihing : (29) . This - facilitation has been: attributed; to change's -in ; ;. 
;j i;i i ! i j imtivatoh (22) , learning (102) , or: both (69 ) . : To understand how these ' 



:-i'.: 



^interptetations differ, see Figure 2. The figure ] pxeseptp thte ! hypotheti- 
' cai performance dataj for two groups trained with ^aifid without L augmented ; . : 
: fe)e<3UDa<;k 5 thktiwere tr or shifted; to .cbimion 

;rest jijfitervalv ppssible outcomes pf' the>transfer^ 

; iustrkted in' A/ B, and C 1117) , l and are explained; below, ; i H; ; ; ' 



; Certain' variables , such as motivating instruction^; (4?) >; stimuiate 

or ' activate the learner to perform^ previously learned; r"^ponses more; ■ - 
vigprousiy/^'^but they have no direct effect on the s-trength of those 
responses /in memory. A variable that raises' or lowers pei^ormahce; when 
present and whose effects disappear rapidly when rempyed .is\ called a i 
performance variable (result A) . ; ! 

■ ' : For/ example , one experiment (22 ) involved the ' acquisition of an elec- 
trbriic antiaircraft gunnery task and the delivery of augmented visual ■ 
feedback- d\iring training . Individuals in the; control^ ; condition tracked 
e^ch ta'rget ; plane using a group: of dots as a ; cxirspr . ; Feedback was : the . 
visual/ error between the dots and the moving target plane ; ;, Individuals 
in th^ augmented 'feedback condition performed the same trackin'gj Jtask as 
thoselin the control condition , but they received ex^ra visual;- cues 

(reddening of ttie target plane) when their responses were on 'target. .^^ 

Individuals in the augmented feedback conditiPn performed ' better 
during training than individuals in the control -condition, but they . did 
not learn moire about the. task than the controls . When s>ab.sequently ' re- 
quired to perform in the absence of the supplementary visual cues, -indi- 
viduals in the experimental group performed no better than those in the 
control group. ■ . / 

■ Experience with' some varV^ibles , such as organizational strategies 
^52,89) /produces relatively permanent changes in performance . If the . 
effects of! this experience pei^sist af^r the variable has been removed, 
the variable is said to be a l^rning ^variable (result B) . For illustra- 
tionr researchers using a pursuit tracking task in which trainees ;could 
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Figure 2. Hypothetical performance data for two groups trained:'jwith and 
without augmented feedback and then transferred to coimmon 
Jy 5 . conditions after a rest interval 
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see xf they on target foiind that performance was enhanced greatl^^ 

:when\ was;, augmented . by; a:..clicker that "sounded when, the ; trainees 

iwere The authors attributed this enhancement to learning 

because - the effect persisted after the clickisr was removed (102) - ; ; 



. ; ; :Some; variables/ such ^ knowledge of results (76) , appear "to af fect 
both ; per fbrmance and^ learning. For these variables , the dissimilarity 
^ between- groups is red^ by a transfer* test (result C) . . Some; research/ 
' indicates that augmente^"^ f eedback may work in this '.way / at . least an ; cpr-; 
;/tcdLri -isiltuations ^ (69).- '■■/-.■■.:'.■ . '.^ ■'•''[■;':.: ''''-■'■■-\^ 

- : i By definition/ performance variables do not have a direct effect; on : 
learning ; or; memory J : /An^important reservation must be:. made> howeyer; • . Any; 
' i ;>/ariafale , - such: as augmented feedback , that can enhance ; an ; i^ndiyidbal* s | : 
] -motivation to : perf o;^ a particiilar^ task also may ' induce ihim to piractiqe ; 
• vharder ^ or more f requently ; few doubt the importance of practice i 'as a i ; 
/variable for: learipan^ and memory (6) , ; Ilius/ variables that raise (^^ 
"ipw^r) a person" s^ motivation to perform a particular" task "aiiso: may act ' ? ; 
-^indirectly to determine What is learned and what is retained. : 



In summary^ a variety of training procedures has been used to augment 
feedback. Some, but not all, produce lasting benefits: Some have no ef- 
feet on perfo^rmance. Some conceivably could produce performance deficits 
when withdrawn (25 ) . It has been indicated that the transfer: paradigm ; / ; ; 
prpvides a fcasis for evaluat;ing foirmally the impact of trairidng variables 
such: as augmented feedback on motor learning and performance - Informally, 
however, 1:he following generalization appears to have some empirical jus-- 
tification as a guide for evaluating a training procedure: ^ \. 

./.a subject must have some cues to the results of his actions 
i^f he is to perform, accurately at- all J and training procedures 
/Sill- be effective insofar as- they help him to observe and use 
/ such cues as aire inherent in the task for which he is being 



/ 



trained/ -,They will fail insofar as they provide him with extra 
cues on. which he comes to rely but which are not available when 
he ch^anges' 'from training to the actual job (143). - 



/ 



Individual Ability Levels - * 

In the acquisition of motor tasks, individuals having higher i nitial 
ability levels generally require less time to attain a specified crite- 
rion than individuals having -lower initial ability levels . This conclu- 
sion appears to generalize across a wide range of military (50,55,,141) and 
nonmilitary (35,36,101) training cqnditions and a number of different op- 
erational definitions of the term .initial ability. 



; j * ; Thus / iiresearch using eight trairying tasks rangi^ig in complexity - from ; ^ 
i.ia simple .reaction time task (monitoring) to a coitibat plotting;;;t:askrprb^ 
'\ leni soiving' (50) , research using a 92-step procedural task ; (^^5) y^arid; 
research usihg 13! Basic Training Skills (141) all defined initial ability 
in teirms. of the trainees* Armed Forces Qualification Test scores and indi- 
cated faster learning by trainees who had higher mental aptitudes. , Other 
> studies, defining initial ability in terms of ; the learner's early per fof-^ 

mahce on a to-be-retained baiahcing task (35, 36) or using expert judgi^tients 
• of ; motor prof iciency as an index of initial ability oh five^ novel gross 
motor tasks (lUl) obtained analogous results. ^ i = ; 

: ;lnjjcbntrast, the weight of the evidence indicates that the rate jat ■ ^ 
which motor proficiency is lost is not related to^a performier*s initial 
' ability level (35,55 ,101,141) . This is illustrated in Figure 3,; i whibh | 
■ presents hypothietical forgetting functions for three groups' of varying . 
initial ability. Note that the .functions are parallel to one;^ianbther,; 
suggesting a common rate of forge'tting. Also note that individuals of 
higher : initial ^ability, achieve higher levels of proficiency during brigi- 
nal training and retain their skill at a higher level over the retention 
period, than individuals of lower initial ability (141|. As a consequence; 
such individuals should require refresher training less frequently 5 than 
persons of lower initial ability. Furthermore, refresher training j can be 
shorter fof- persons of higher initial ability because they * retrain! to 
standards more quickly than persons of lower initial cibility (55) !. 

Procedural Variables 

Level of Original Learning |' . 

A niomber of authors (48 ,51) have described the learner's l/evel of 
original learning as the : single most important determiner of ' mbtor mem-- . . 
6ry . One study, using a three-dimensional flight-control tasky (48)-, 
found extremely high positive correlations (. 80 to .98) between the 
leiarnefs" initial proficiency levels* and later ^retention, "This evidence 
is compelling because the strength of these correlations did |hot dissi-- 
pate through time. The. relationship between original learning level and 
retention' remained high and stable over retention periods ranging from 
l: month to 2 years, * i/ 

. ' ■ ■ - . : ■ ^ ■■ ■ ■ \ ' 

' Given the importance of original learning as a. determinant of reten- 
tion, some consideration must be given to the variables thought toV con- 
tribute most heavily to the motor learning process. Triese are knowledge 
of results, for example, "right," "wrong,", "too long," "too short"; and 
response-produced feedback, for example, proprioception, /vision', and 
■ audition. X ■j 
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Hypothetical forgetting functions for three groups of 
varying initial ability • ^- ^: ^ . ^ 
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Knowledge of iResults , Knowledg^ of results refers to externally > 
provided error information about ; the Vdiscrepancy between a learner *s ac- 
tual response and the . intericled responses. Announc^emerits: such as "right, " 



3 inches too far" are examplep of knowledge/Of results.. An 



i wrpng> 

account of the role of knowledge of results in motor /learning is beyond! 
the ' scope of this report; there are several literature reviews available 
on the subject (4/25 ,[97 , 116) • Two poinjts from that/literature howeveir# 
are especially pertinents: L /'^ 



1. The early acquisition of a skijll depends heavily upon knowledge 
/ of results . . Perfpnnance generjally improves with knowledge of 
i results and "deteriprateSfc or s!hows ; no further improvement , . wheri 
. : ... knowledge is . withdrawn (24 ^96) . Only latter in: learning, I once a; 
performance has become "internalized may knowledge of results 
be withdrawn (or its absoi\ite frequency reduced) without^^eri-^ 



otisly impairing, performance (^6,118) . 



In the relationship between tl^^ amount of information provided 
by knowledge of resul*:s (its or'^pision) and an individual's rate 
of learning and final level pjT pe^rformance/ the find- 
ing (133) has been that performanq;e is f acirSs^tated by increases 



in the precision of knowledge 



of results/ buy only up! to a point . 



If knowledge of results 
amount of information 
crea'sed beyond that whi 
the time allowed, a decj 



5jnfes top precisey^ that iS / ifc the 
by' Jcnowledgy^ of results is in- 

>r6cg$a«l by the learner within 
Ln i^erformance will result (110) . 



In general individuals'^who receijve more and better knowledge of 
results require less training time and achieve a highei: ;erid~of~training 
perf orrnanoe level than those who do .not. ; This suggests 'that- any added 
effort to provide more or better knowledge of results to' trainees would 
be 'worthwhile. It also suggests that Ispecial attempts must be made to ^ 
facilitate the delivery of knowledge of results in situations that tend 
naturally to inhibit the presentation fof its information. " . : 

For, example, a major source of difficulty in training marjv team tasks^ 
is In detecting and correcting the errors of individual team llrapibers. Al-v 
though a variety of factors contributes to this; problem, it appears, to 
stem primarily from thp intdractiye effects ^of the teaih members' respond- 
^ing and the difficulties involved in simultaneously monitoring the behav- 
'ior Of several' indivic^uais (142) . . If techniques could be devised tc< 
facilitate the; presentation of more or better knowledge of results in 
situations like these 
to be realized. 



a higher level of trainee performance is likely 



" Response-Produced Feedback s , The' theoretical status of response- 
produced feedback Auring motor ^learning is still controversial (3^5^67, 

; _68 ) .,_j3ut_ jEewl-.daubiL-i^^^ preidtical impoirtance for the acquisition of new 

. motor responses. / Most" theorists (4,67) contend thatj early in learning, 
the learner uses knov/ledge of results in relation with the feedback 
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information he receives, for exampre, proprioceptive, visual, or auditory 
' cues, to establish a; memorial representation of how a correct performance • 
feels, looks, and sounds .■, This representation is assumed to be weak ini- 
tially, so the learner must depend heavily upon knowledge of results for . 
information about the correctness of his performance (24,96) . 

Later in learning, however, after a stronger representation of the' 
■ correct performance has been stored in memory, the Mearner can detect and 
: correct movement errors by comparing the feedback qualities of his present 
■ per formante with those of the stored representation. He no longer needs 
to depend upon knowledge of results for information about the correctness 
of his performance (,96). This information is inherent in the feedback 
' that he,has received from past performances, and that he re«?eives from his 
present performance, and the information enables him to "Icnow" when a 
nerfoonance is correct in the absence of knowledge of results. 

- ■ • ■ . ' ' " / ' 

The notion (4) that motor; learning and perf orrnante depend upon the 
■quantity, for example, .nuiriber of feedback channels and amount of practice, 
and quality, that is, fidelity' of tVie^ response-produced feedback the in- 
dividual receives has solid empirical support. The ;more response-produced 
feedback thag the learner receives, the more accurate and confident he . 
becomes in his responding (6,7,8.119). Also, retention is facilitated b^; 
increasing the amount of origiml practice\or number, o f available feedback 
channels, for example, vision vor^sus no vision . Evidence for this has 
been obtained under a wide variety of task conditions (87,94,134) and 
retention intervals (10,14,130). \ 

Increased l.evels of original training facilitate retention, but Is it 
cost effective to train Ipeyond one sticcessful performance, or is such 
overtraining' excessive and wasteful? '\ , ^ 

■ ■ ' i ■ ( ^ . ' 

Overtraining, or mastery training, is important, and it, ma y be more 

.> ^cost' ef;gective than proficiency training, that: j is, traini ng to some- mini- 
mally agiceptable level. Mastery training is kijown to enh ance retention 

^ (58,95/92)^ This is a predictable result, but ' it has important implica- 
tion'S/for Anriy. training policy.. Currently, the .Army, relies heavily upon 
i combinations of prof iciengy training and i^fresher training. The problem 

is -itiat refresher training invqlvrSBs.-time , |^),e^sonnel , and equipment costs 
^ thaSTcannot be minimized iwithout firsV.,mi3iiI^lizing the need jf or refresher 
training. One way to do this is t6 '^extenW original training. If future 
research shoulA- show that retention, folloi/ing mastery training equals., or 
exceeds retention following an equal amouint of proficiency training plus 

; refresher training, a mastery training policy would appear to be the one 
to adopt . . ' ; 

/ The benefits of mastery training extend beyond improved retention.- 
, Theory (4,31,45,65,66) and data (27) suggest that the skille d performer 
is able to devote less of his total attentional capacity to a n ongoing 
task than the novice . Mastery training thus frees the performer either 
to' attend to other tasks or to concent^r^'te upon different aspects of his 
main task. • ,. • 
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Furthermore, there is evidence Suggesiting that mastery training tnay 
reduce the inhibitory effects of \anxiety-ar6using or. stressful envxron-^ 
ments upon performance (79) . StaVed another' way, the stressful environ-^- 
ment that may distract the less-skilled individual and disrupt his 
perfoipmance may not seriously impair the highly skilled individuaiVs 
performance. If this hypothesis* is supported by future research; it hai^ 
clear implications for Army traiining. in particular , the common belief 
may be incorrect that trobps must ^ be trained under sin^ulated combat or 
other generally stressful .conditions to react apjpropriately wh^^^^ placec^ 
in an actual combat situation, i^aistery training alone may protect a 
soldier's performance from the interfering effects of an anxiety-arou^i^ ^ 
or hostile environment , : 

Physical practice is important in the accjuis^-tion^ and perfoirmance 
motor tasksV However, there is evidence that the performance of some pk ^*- 
tor tasks can be enhanced as : much or more by Omental practice" (104vl05) . 
One interpretation for this effect is that meirital practice produces activr 
ity in thie muscles involved in the performance of a task and that thisf V 
activity transfers positively to performance: Although this interpreta-^ 
^,ion has eropirical support (105) , another more reasonable interpretatioji 
i/s available. There is ev^^dence that mental practice facilitates the Qc^gr 
•riltive, problem-solving aspects of jno tor learning.' For example/ predotti>' 
xnantly motor tasks, such as tracking (128} > show little benefit from - 
mental practice, whereas' tasks that require "the learner to depend heavi,}y 
upon intellectual, prpblem-solving skills , such as procedural tasks (10$)/ 
generally reveal substantial benefits due to mental practice. 

ftlso> some physical practice on a task enhances the effectiveness 
mental practice. As physical pr^ictice continues , however , mental prac-- ' 
tice becomes inc^reasingly less effective (122). This observation is' cofj*- 
sistent with the- view that mental practice subserves yerbal-cognitive/ 
processing during motor learning. It is during the initial stage of mot^br 
learning that verbal-cognitive activity is assumed to be prevalent (4,4^ r 
65,66) , ^ ^ 

Although clear evidence on mental practice is difficult to obtain 
(105) , closer scrutiny of the phenomenon is warranted. If, fojr example', 
me/ital practice alternated with physical practice can enhi^nce or^malnt^in 
performance on hazardous tasks; such as disarming explosives, or infre-^ 
quelitly performed tasks, such as launching missiles^ ti^ia potential ben^-^ • 
fits are great. ..^ o . 

Refresher Training 

, Time to retrain individuals to original performance levels is genQjr-- 
ally rapid, that is, consistently less than 50% of the original traiiniij ^ 
time ( 14 , 59 ,'8 7) . However, length of retraining time is much longer fojr 
(a) longer retention intervals (14,95), (b) more difficult tasks (73), ^nd 
(c) for procedural tasks rather than continuous tasks (14,59,87). In' 
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addition, highly trained individuals tend to require more training time 
to regain their old levels of proficiency than less-trained individuals 
(14,87)- Thi« latter result requires some--erarif ication. Why should 
forgettihg increase with training? Although this effect may seem counter- 
in-tuitlve/ it concerns^ forgetting in an ^soliite sense. Because highly 
trained individuals ' have more' to forget, they' have more to relearn- 

• Several investigations using military personnel have demonstrated 
that persons with practice during the retention interval -perform better 
than thoee with no practice (72,123,124,125). For example, an experiment \ 
examining the effects of various practice strategies upon the long-term 
retention of ^sixqulatfed manned spacecraft operations (124) showed that per- 
formance on the procedural aspects of the task deteriorated to an unaccept- 
^taie level within 1 to 4 months of no practice. 

At the end of 1* month of no practice, trainees required, fiye times 
longer to complete the procedur.al sequence than they did at the end of 
training* Additional performance decrements were not evident after 2 and ^ 
3 months of no practice. '^However , after 4 months of no practice, trainees 
required 17 times mcrre time to complete the procedural sequence than they 
did at th^ end o^ initial training. In sharp contrast to these da[ta, 
trainees afforded some form of practice during the retention interval 
showed no signs of loling theii^ end-of-training proficiency levels on the 
cedural sequence over retention intervals measured up to 6 months. 

Refresher training; tnay provide opportunities for new learning . For 
illustration, researc)iers using a team of aerospace test personnel showed 
a substantial improvement over original training levels following 
refreshen -training 13 weeks, after original training OS) , - 

" Refresher training . techniques- may improve on-the-job sa fety and per- 
formance (38,51) . In particular, development of practice modules for 
safe practice of a dangerous or critical task immediately prior to actual' 
task executiQfi may result in fewer a<:cidents and a higher quality output 

(123,124,125) . ' 

• ■ ! ' / 

Warniup Activity . ' Closeiy relatied, to the topic of refresher training 
in the literature on the effects of a j^reparation . or warmup period, on 
retention test performance (117) . ; A y/armup period c an promote retention, 
but it depends upon the particular ta|sk and warmup activity . Many^ inter- 
vening activities are ineffective as warmup activities, and some result in 
poorer retention th'an a rest period (121).. More res-fearch is needed on the 
effectiveness of various warmup activities on particular tasks to clarify 
this issue . 

'Some evidence (90) suggests that "neutral" tasks ,. involving activi- 
ties unrelated to the task to berecalled, can be effective as warmup 
activities. If this is the case, it has practical implications for the 
Army. In particular, the introduction of a neutral warmup activity prior 



to the perfonnance of ah infrequently performed, such as launching a 
missile, or dangerous task> such as combat, may prove an effective means/' 
of improving performance . 

Transfer of Training - . 

Transfer of training refers to the influence of past learning on new 
learning. Learning one task may help in learning or performing another 
task (positive transfer) or may interfere with the second task (negative 
transfer). For example, the responses acquired while learning to drive 
an automobile may alter the responses one makes when learning to drive a 
tank. Trcinsfer depends upon the similarity of ^ the stimuli and responses 
involved in tasks A and B (61,62,63), the individual's lever of learning 
(1,42,)&1,75,78,145) , and the difficulty of the ' tasks- .(17,61, 77) . 

Positive transfer effects are observed typically wheji transferring 
^between motor tasks, but the strength of the effects are usually small 
because of the differences between tasks and biscause of the effects of 
forgetting (1) * The bbseryation of negative transfer depends primarily 
upon how it is defined '(23,61,62 ,63,75,80,82,117,145) . If an overall 
decrement in performance is required for negative transfer, then the 
following conclusions are justified: Negative transfer is difficult to 
produce and, when produced, it obtains in negligible amounts and rapidly 
converts to positive transfer (23), If, however, negative trainsfer is 
defined in terms of the occurrence of an occasional, intrusive wrong 
response, then it may be a practical concern* Intrusion errors, although 
isolated, can pccur within an overall context of ^positive transfer- (75) , 
and these errors may have serious consequences for the hiaman operator or ' 
the equipment being operated. Thus, the pilot who is experienced with 
one aircraft may have no problem, relative to the complete novice, han- 
dling the .controls of a different aircraft up to the point when a fatal 
error is caused by the pilot's previously established flight'T»control 
responses (63) . Although such errors can be avoided by training within 
a controlled environment, such as use of a simulator, training is 
required • , .. . 



Trace Decay and Interference ■ ,^ 

Trace decay and interference are; theories of forgetting* Trace decay 
theory' states that information deterip^rates from memory solely as a func- 
tion of tirae^ (2) . One study indicates. thsCt information about discrete mo- 
tor' responses starts decaying as soon ias it enters memory (129). However, 
there is no evidence about the decay of continuous motor information and 
the extent to which trace decay influofnces the retention of motor skill 
over prolonged no-practice intervals » . 



~ Interference theory states that forgetting. is caused by competition 
iromre&pbnsds learned either bef or after a response to be renumbered. 
When the acquisition of task A degrades the retention of^ask B, iJrOactxve 
ihterference is said to have occurred. The acquisition of^T^as^^A^also may 
enhihce the retention of task B. This is known as proactive facilxtafej 
•The inhibitory effect of .task B on the retention of task A is known as 
retroactive interference. The converse of retroactive interference is 
khowh as retroactive facilitation. 

Few ■ ^investigations have been conducted of proactive- (43) and retro- 
active (75/80,82) :interference that used motor tasks and retention inter- 
vals longer than a few seconds. Based on the evidence obtained, it 
.appears that interference effects, like overall decrements due to negative 
transfer, are difficult to produce and, when produced, persist typically 
fox little more than a handful of trials . Also, these effects appear to 
be restricted to situations in which identical stimuli signal antagonistic 
responses (117). Unless two tasks employ identical stimul i and require 
antagonistic responses, facilitation effects can be ant icipated generally. 

Schedules of Practice 

Gontihuous Tasks . Learning appears to be slower when praciiice ses- • 
sions are longer and heavily massed than when they are shorter and occur 
~ at more comfortable intervals {13). However, most motor learning, theo- 
rists (61, .117, 121) are .reluctant to conclude that spaced practice xs xaore 
conducive to learning and retention than massed practice. Rather, the 
theorists contend that individuals practicing under massed conditions may 
be more susceptible to the effects of bbreciom and fatigue than those prac- 
' ticing under. spaced conditions. As a result, the relatively poor perfor- 
mance of individuals in the massed condition may not reflect th^ amounts 
that they are actually learning, "fo support this contention, a substan- 
tial body of evidence (11,74,103) indicates that persons who are given 
rest after practicing under massed conditions can demonstrate levels of 
learning Equivalent to those achieved by individuals practicing under ' 
spaceid conditions. • . 

Although ther^ is generally little Or no dissimilarity in the reten- 
tion of groups trained under massed and spaced practice schedules, an 
important cautionary note is necessary. The acquisition^ of danger ous or 
highly fatiguing tasks hiay be impaired under massed, p ractice conditions^ 
(117). That is, learning and performance may be hindered if the task .is 
too dangerous or too strenuous- to be attempted repeatedly in the absence " 
of rest". In support of this, hypothesis , the literature on vigilance 
indicates that humans cannot maintain a high level of performance m tasks 
that require continuous sustained attention (32) . If rest opportunities 
are not provided, individuals lose their motivation to perform or show 
involuntary lapses of attention. . If these lapses of attention accumulate, 
they roaKjiinder the early learning of persons in the massed practice con- 
dition relative to persons in the spaced practice condition (61) . 
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\ Discrete Tasks . In contrast to continuous 'tasks, the scheduling^ of 
practice apparently, affects neither the acquisition nor performance of 
discrete tasks (37,117). No data are available concerning the effects of j 
different* practice schedules on the acquisitipn and performance of proce-/ 
dural tasks. However, it is likely that the effects of distribution are. 
quite small and relatively unimportant when measured against the inf luende 
of other learning variables . This hypothesis stems from both the obsejrva- 
tion that the" distribution of practice typically has little or no effect/ 
uppn the' acquisition of lists of verbal items having some degree of inteir- 
nai organization (138,139) and from the common belief that *the motor f 
rresponses involved in most, procedural tasks have a strong ^^rbal component 
(2,117)* In the absence of further research, however, therle-yis no way to 
confirm or deny this hypothesis. , " 

- — ^' • • \ f ■ 

In s\Hmnary> the manner in which practice occasions are arranged tqfm- 

porally generally does not 'have a strong effect upon individuals' final 

level of original learning , The number of practice occasions offered Is , 

an important variable . \ Therefore, in limited-duration training^^ programs , 

better retention^ should result using massed rather than spaced practice 

schedules; The fact that massing allows more trials per unit time and \ 

hence more opportunity for initial learning is the basis for this 

interpretation (23, J.17) . 

Whole- Versus Part-Training Methods 

The trainee may learn a task by practicing the entire task from/ the 
beginning-T-whole prac1:ice--or by dividing the taisk into a number of dis- 
crete parts---part practice* In the part-practice situation, -the learner 
practices each part separately or -in conjunction with other parts and 
later integrates the parts to form the whc^e^task. Obviously, there is 
no way to define the meaning of the terms -partyor whole because' specif ir-' 
catUon depends upon the particular task (61) y ' " < 

Four general categories of variables seem to have ^n effect u^oh the 
^effectiveness! of . part- versus whoie-craining methods (91) r 

1* Task to be. learned, for ^xample , organization, difficulty 

2. Learner variables, for exaA\ple, intelligence, age, experience, 
preference; ' 1 



3. Training situation, for example, amount of practice; anq 

4. /Performance measures, for example, time or trial scores 



^ Task to Be Learned , The effectiveness of part- as opposed jto whble- 
training methods varies with the difficulty of a task ' s independent sub- 
tasks and the degree to which the sub tasks are interrelated (53,|61, 117, 
121) : , . . 
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It generally is easier to learn simple to moderately difficult 
- {. task^ using whole-training methods rather than part-training 
methods, whereas the opposite, is true for more difficult tasks 
" (121) . ' 

2; Tasks requiring high coordination and timing of their serial- 

inotor components are learned faster using whole- training methods. 
In contrast, partrtraining methods tend to be more effective for 
' ta^sks that can be divided into meaningful independent sijbtasks 
«... ^ (30,93) . ■ * _ ' 

3. There appeals to be an interaction between task difficulty and 
task organization that influences the rela^tive effectiveness of 
pjart- and whole-training methods. Thus, training for tasks of 
-high organization becomes increasingly more effective with whole 
practice as task difficulty increases . On the other hand, train- 
ing for tasks of low organization is increasingiy iiriproved by 
part practice as task difficulty increases (91,93) 2 

Learner Variables . There i-s some evidence that more inte,lligent 
. individuals may learn and hence retain ignore usir^g whole- rather than p^rt- 
training methoc^s . Evidence for this conclusion comes from a study of the 
use of whole- and part-training methods to teach rifle marksmanship to 
Army Basic Trainees (84). Although the whole- training method was found, 
to be superior in slow-fire routines for all trainees, the more difficult 
task of sustained fire was facilitated when the whole method for only 
trainees 6f above-average intelligence was used. V V " 

Individuals who are older (school-age subjects), who have more task- 
related experience, or who are performing a preferred task also tend to 
learn faster and better when whole- - rather than part-training method s are 
used. These results have been iriteTcpreted in terms consistetit with the 
hypothesis that less difficult tasks -are more amenable to whole^ rather 
than to part-training methods (91) . This is a reasonable interpretation. 
Prekumably,. a task is simpler foi-, older, inore intelligent, or more experi- 
enced persons. To the extent ttiat a person' s, preference to per form . a par- 
ticular task may be related to task difficulty, it may :be vi-ewed as an- . 
other condition under which task difficulty influences training-method 
effectiveness. 

Training Situation . As traini-ng continues,, learfiing is increasrngj-y 
benefited by whole practice (91). Apparently, this is another instanpe 
' in which task difficulty is the variable underlying the effect. Practice 
facilitates the ease of ; a performance, causing later learning to be more 
cumenable to whole- than to part-training methods. 

Performance Measures . Different Results are sometimes obtained when 
different performance measures are used . ■ In particular, time scores oc- 

, casionally favor part-training methods whereas trial measures sometimes •• 
favor the whole method. However, this effect appears to be artifac[tual 

. (91) - . • 



. ' Part-^Whoie Learning and Long-Term Retention , A search of the whol^- 
versus part-training method literature for information about the impact 
of this training variable upon long-term motor memory was almost in vain, . 
One; set of experiments was found on part-whole learning and long- term mo- 
tor memory (112,113). The author failed to show any differences, however, 
betwefen conditions during original learning and retention. * . 

- Although retention should benefit from the training method that. ^ 
yields the higher original training level, both part- and whole-training 
methods may produce substantially equivalent training outcpmesv (112 , 113) . 
Under these conditions, it may be more cost effective to use the part 
method. The part method, typically employs, or can employ r simulators (9) , 
that eLre usually lower in operating costs i more adaptable to training 
requirements, and less hazardous to the operator (140) than the opera- 
tional equipment. - \ , . 

Additional Test Tibials 

Performance tests have been perceived traditionally as tests of 
learning or memory. Jt is becoming increasingly clear-r however, that test 
trials themselves 6ontribute to the learning process. Evidence, concerning 
the effects of additional test trials, without knowledge of results, comes 
primarily from studies. of verbal memory;, at least two conclusions appear 
justified on the basis of it. 

.■^ . . ' ' • " ' 

1 , Memory ds facilitated greatly by the addition of a test trial 
given prior to final testing .. For example^ investigators studying the- 
long-term retention of verbal paired-aSsociates found that the addition 
oi an immediate test, after 10 paired presentations of .the stimulus and 
response members of an item, reduced error frequency by nearly 50% as com- 
pared to 10 paired presentations without the retentipn test . In addition, 
long-term j^etention^ as measured by the ^andTividuals ' response latencies as 
well as' their error frequencies, showed further improvements when five 
test trials were introduced prior to the final retention test (12). Con- 
verging support for this conclusion comes from a host of experiments, many 
of which have been reviewed elsewhere (15,108) . In general, final test 
performance is faster (44), more accurate (26,106,107), and more stable 
(34), and relearning is quicker* (108) when additional . test trials, without 
knowledge of results, are' provided. 

Evidence is lacking concerning the effects of additional test trials, 
without knowledge 'of results, upon the retention of motor skill. Indeed, 
this survey uncovered only one experiment on the topic . It involved .the 
acquisition and retention of a simple linear movement (41) . Contrary to 
expectations derived from the 'verbal learning literature the introducrtion 
of additional test trials during the retention interval did not aid reten- 
tion. In fact, individuals in the experimental groups became increasingly 
less accurate, that ^is, more variable, over successive test trials. 



It may be that additional test trials introduced during the retention 
interval do not enhance motpr retention-, but this seems very unlikely.- As 
has been indicated, additional test trials have clear, beneficial effects 
upon the retention of verbal materials. There is no apparent reason to 
expect that these effects differ across response classes; It would seem 
more likely that the experimental design employed by, these authors was 
incapable of identifying the effects of additional test -trials upon motor 

retention • More research on this issue clearly is indicated. 

. . .... " 

2 . Additional test trials are equally if not more beneficial to 
learning and retention than study opportunities . A recent experiment 
using a verbal memory task, illustrates the effectiveness of additional 
test trials as a variable for long-term retention (60) . Researchers 
tested groups of individuals for the retention of a list of words after a 
48^hour retention int:erval. One group was exposed the list four times 
before the final retention. test , that is, :study-study-study-study-test . 
A second gr'oup receiVed a single presentation of the list and three test 
"trials prior to the final retention test, .that is^ study-test-test-test- 
test. Even though the former group was permitted four times more study 
time on the' list than the latter, the final retention of the latter group 
w^s far superior to that of the former group- 

A number of interpretations have been offered to account for the 
facilitating effect of additional test' trials on t:he retention of verbal 
material (70) . Perhaps the most plausible of these is that additional 
test trials enhance the recovery of information from memory either by 
facilitating its organization (28,40,111) or by enabling ,th6 learner to 
develop a plan, or strate*^, to retrieve the appropriate infprmation at 
the time of testing (57). It is also likely that test, trials help the 
learner to determine where learning is incomplete . Thus, on 'a given 
training trial, the learner, may . recognize material he missed on the pre- 
vious test trial and concentrate on that rather than devote further 
attention to previously learned material (70,132). ^ 

The observation' that additional test trials may be more beneficial 
' to learning than additional s,tudy time has important practical implica- 
tions for training. In particular, it may be . possible to reduce overall 
training time, product a more effective trainee, or both, simply by af- 
fording the trainee more test-taking opportunities. Tests of the gener- 
ality of this hypothesis . are necessary to determine whether"' additional 
test tirials- facilitate 'the retention of a wide variety of tasks. . TheN 
Army ,^R^ search Institute has .begun research on this issue. 



SUMMARY 



"This review is bas^d upon a wide variety of data.. ' Although military 
delated findings were incorporated wherever possible, some of the experi- 
ments cited used tasks haying little direct or obvious relationship with, 
skills currently maintained within the Army. In addition, conflicting. 



data and data pertinent to a more detailed understanding of the behavioral 
conse<5uences of an extended n6--practice period generally were skiiraned. over 
to lend icoherence to. this report. In so^doing, an oversimplified picture , 
of long-term motor n\emory and the variables that may affect it hasr been 
sketched* These constraints notwithstanding, a number of tientative con- 
cLusions have empirical support: ^ 

1. Discrete motor responses, particularly those involved in pro-- 
ceHural tasks, are moire likely to be forgotten over a nd- 
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prac^ce period than are continuous motor responses. . .'j 

Retentioh^of skill is a decreasing function of time, and the j 
shape of the function depends upon a host of variables, includ- 
ing the length' of the no-^practice period, the type of^ tasjc, and 
the availability of practice or , the presence of interfering/ 
activities before or during^ the retention interval. 

3. Apparently, learners can impose organization Aiffbn psycholog- 
ically unstructured tasks via the liearning process. As/ a result, 
task structure is not an important variable for tdie lohg-teirm ^' . 
retention of well-learned responses, although^ it is an important 
variable for the retention of less well-learned responses. 

4. Functional, similarity is a necessary -and sufficient ponditfion 
for- learning procedural tasks. ' 

5 . ^ispiay -cpntroi relationships can influence the ease of motor 

learning and transf er and, to some degree , th^\ quality of per- , 
formance after a retention interval . 

6. Visual cues designed to supplement the. informa'tion provided by * 
:.^-^"ir task display are informative . early in learning-;^and may facili- 
tate the learning process.. Later in learning, j however, these 
cues become relatively unihformative and unimportant as deter- 
miners of retention. , 

■ , ^ . . — 

7. Augmented feedback can enhance perfoipnance by enhancing motiva- 
tion, learning,, or both. i . - r 

8. Individual ability level's are impor>tant as determiners of reten- 
tion insofar as they influence a person^' s rate of learning and 
final level of performance . .;;rndiYic^uals of higher initial abil- 
ity tend to achieve higher levels^of proficiency and retain skill 
at a higher level than individual's of lower initial ability. > 



9, The single most important determinant of motor retention is 

level of original learning. Infoicmation obtained from knowledge 
of results and response-produced feedback '^is thought td contrib- 
ute most heavily to a trainee's rate of learning and final level 



. of performance. Infosmtion provided by ^i)cnowledge of results 

.' increases with its availiOj^lity and precision. Information 

• provided by response-produced feedback increases with its 

• quantity, for example, nuiriber of feedback channels and amount . 

. . of practice, and quality, that, is/ fideiifty. 

10. Refresher training can serve as an effective source of new 
learning as well as - a means for . reestablishing forgotten 
responses. Refresher training -also may provide a relatively 

• , simple means .of improving on-the-job safety and performance. ._ ^ 

•■ Learning and retention are'" benefited by test-taking 

opportunities. ■ 

12 Occasional, intrusive wrong responses induced by past learning 
^ .. . may have serious consequences for the human operator or the 
• equipment he is operating. 



CONCLUSIONS 



. Returning to the main issue:. What "procedures ban the Army reason- • 
ably .use to insure that its personnel remain job proficient over pro- 
longed pexiods of no practice? 

: More, basic and applied reseairch , is clearly indicated. Suggested , 
during the course of this . review were a ..umber Of , issues and avenues^for_ 
research aimed at increasing ^training effectiveness . j Because long-term^^ 
retention appears to. depend so heavily upon a traineel s orxginal learhing 
Svel! this^would seem, at lea^t initially. ;to.be.^l?e.Wt dxrect^an^ 
effeciive means of attacking the issu^ of skill.maintenance m the Army. 

■ Stepping up research' efforts" is not all that needs doing to 

a more p^^ficient Arn^ trainee. • ^-^-^^-^^^r t^^Scuiar varJ^ 
.it permits inferences to be drawn about the effects of ^f)articular^vari 
abl^s upon the retention of particular performances Researu-,. does 
enable one to determine when a given individual, or team lacks : 30b pro- . 
ficiency? Ihis fact is of- fundament importance if the Army is to have 
. a cost-effective refresher training program. 

More emphasis "must fee placed upon the use ot local indiyidual^pro- . 
f iciency ex^inations for: example , some more frequently administered _ 
variant of -the Skill Qualification Test. This ^^^^^^ ^ ^^"^ 
plest and most economical- program to ' adopt . Those who ^^^^ 9^^^^ 
strate proficiency can receive refresher^training tailore^ to ^heir spe 
cific needs. Those who retain their proficiency can be freed for other 
duties . . 



Individual performance evaluations caii provide other benefits to' the 
individual trainee as well as to those in Supervisory positions. For ex- 
ample, the Job Performance Evaluation program currently being developed 
by American Telephone and Telegra{)h Company (56) uses a uniformly applied 
se.t_of performance ;5tandards to^ judge objjectively the quantity and quality 

r of work of individual eraployeesf. The employee is informed exactly what he 
isL' being held accountable for and is told specifically how his performalnce 

^pcHmpar^s with management's expectations (■ As a result, the employee knows 
i^ef iciencies in performance and can modify thfe direction and level of his 
4'ffort^.' ^ 



li 
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In addition, supervisors receive /precise information about the pro- 
V - Iductivity of individual subordinates by which they can (a) modify and 

[thereby . improve training programs; (b) increase the validity of procedures 
. /used to select and to promote employees; and (<c) improve their own job 
r'^ej^formance by learning more about the progress of their subordinates\ as 
. //' well as the progress of their work group as a whole. 

i . The. assessment of American Telephone and Telegraph's evaluation 

/ ] program is only beginning: The su(^cess of the program to date is based 
primarily upon anecdotal reports o^f improved employee productivity and 
^ mprale. Nevertheless, their program, or one /like it, appears* to be par- 
ticularly suited to many Army requiretnents in this area and definitely 
warrants the Army's consideration'. ' 
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HQOA (DAPC PAS A) - ' 
HQDA (DUSA OR) 
HdDA (DAMO RQR) 
HQDA<DASG) 

HQDA (DAI O-PI) ' - 
Chief. Consult Div (DA-OTSG). Adclphi, MO * 
Mil Asst. Hum Res, ODDR&E. OAD (E&LS) 
HQ USAR AU APO Seattle. ATTN: ARAGP-R 
HQ First Army, ATTN: AFKA OI TI 
HQ Fifth Army. Ft Sam Houston , ' 

Dir. Army Stf Studies Ofc. ATTN: OAVCSA (DSP) 
bfc Chief of Stf. Studies etc 
DCSPER, ATTN: CPS/QCP 
Tfje Affiiy Lib, Pentagon, ATTN: RSB Chief 
tlie Army Lib. Pentagon. ATTN: ANRAL * - ' 
bfc. Asst Sect of the Army (R&D) 
Tech Support Ofc. OJCS 
USASA; Arlington. ATTN: lARD T 
USA Rsch Ofc. Durham. ATTN: Lifte Sciences Dir 
USARIEM^Natick. ATTN: SGRD UE CA 
USATTC. Ft Clayton, ATTN: STETC MO A 
USAIfilA. Ft Bragg. ATTN: ATSU CTD OM 
USAIMA, Ft Bragg. ATTN: Marquat Lib 
US WAC Ctr & Sch. Ft McClellan. ATTN: Lib 
US WAC Ctr & Sch. Ft McCleUan, ATTN: Tng Dir 
USA Quortermastcr Sch. Ft Lee. ATTN: ATSM-TE 
Intelligence Material Dev Ofc, EWL, Ft Hoiabird 
USA SE Sl^al Sch. Ft Gordon, ATTN: ATSO EA 
USA Chaplain Ctr & Sch, Ft Hamilton, ATTN: ATSC^TE^RD 
USATSCH. Ft Eustis. ATTN: Educ Advisor 
ISA War College. Carlisle Barracks. ATTN: Lib 
RAiR. Neuropsychiatry Div 
OlVsOA. Monterey 
. USA Concept Anal Agcy/Bethesda. ATTN: MOCA-WGG 
;;i USA CoWpt Anal Agcy; Bettiesda. ATTN: MOCA-MR 




USA Concei^ Anal Agcy, Bethesda. ATTN: MOCA-JF 
USA Artie T^^Ctr. APd Seattle, ATTN: STEAC-MO-ASL 
USA; Artie Test Ctr, APO Seattle, ATTN : AMSTE-P L-TS 
USA Annarnent Cmd,. Redstone Arsenal. ATTN: ATS>?-TEM 
USA Armament Criwi. Rode Islehd, ATTN: AMSAR-tOC 
FAA-NAFEC;AtJdntk City. ATTN: Library ^ 
11 FAA-NAFEC. Atlantic City, ATTN: Hum Engr Br 
t ' AeromKJtlcai Ctr. Oklahoma City. ATTN: AAC-44D 
2 LrSA Fid Arty Skih. Ft SHI. ATTN: Library 
1 USA Armor Sch, Ft Knox, ATTN: Library 
i USA Arrpor Sch. Pt Knox, ATTN: ATSB-Dt-E'^ 
1 USA Armo'rSch. Ft kriox. ATTN: ATSB-DT«TP 
" rmor Sch. Ft Knox, ATTN: ATSB-CD-AD 



2 
1 
2 
1 
1 
1 
1 
1 
1 

1 
1 
2 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 

^ 
1 
1 
1 
1 

\ 3 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
2 
1 
1 
1 
1 
1 
1 
t 

^ 
1 

2 
2 

1 
1 
1 
1 



HQUSACDfeC, Ft Ord. ATTN: Ubf ary ' 
HQUSACOEC. Ft Ord. ATTN: ATEC-EX-E-Hutp Factors 
UiSAEEC, Ft Benjamin Harrison, ATTN: Library 
USAPACDC, Ft Benjamin HarrJson, ATTN: ATCP-HR 
USA Comm-Elect Sch. Ft Monmouth, ATTN: ATSN-EA 
USA^C. Ft Monmouth. ATTN: AMSEL-CT-HDP 
USAEC, Ft Monmouth. ATTN: AMSEL-PA-P 

USAEC. Ft Monmou tH, ATTNrA MSE L ■ S t-^ 

USA6'C, F/ Monmouth, ATTN: C, Fad Dev Br 
USA Materials Sys Anal Agcy. Aberdeen. ATTN: AMXSY-P 
Edgewood Arsenal. Aberdeen, ATTN: SAREA-BL-H " , 
USA Ord Ctr & Sch. Aberdeen. ATTN: ATSL-TEM-C ^ ^ 
USA Hum Engr Lab, Aberdeen. ATTN: Library; Dir ^ 
USA Combat- Arms Tjig Bd, Ft Bennihg, ATTN: Ad Supervisor 
USA Infantry Hum Rsch Unit, Ft Benning, ATTN: Chief 
USA Infantry Bd. Ft Banning. ATTN: STEBC-TE-T 
USASMA, Ft Bliss, ATTN: ATSS-LRC y 
USA Air Def Sch. Ft Bliss, ATTN: ATSA-CTD-ME 
USA Air Def Sch. Ft BlisS. ATTN: Tech Lib 
USA Air Def Bd. Ft.Bliss, ATTN: FILES 
USA Air Def Bd, Ft Bliss. ATTNi STEBD-PO 
USA Cmd Bl General Stf College, Ft Leavenworth, ATTN: Lib 
USA Cmd & General Stf College, Ft Leavenworth, ATTN: ATSW-SE-L 
USA Cmd & General Stf College, Ft Leavenworth, ATTN: Ed Advisor 
USA Combined ArmsCmbi Dev AcC. Ft Leavenworth. ATTN: DepCdr. 
USA^iombined Arms Cmbt Dev Act, Ft Leavenwortll. ATTN: CCS - 
USA Combined Arms Cmbt Dev A«, Ft Leavenworth, ATTN: ATCASA 
USA Combined Arms Cmbt Dev Act, Ft Leavenvrorth. ATTN: ATCACO- 
USA Combined Arms Cmbt Dev Act, Ft Leavenworth. ATTN: ATCACC- 
USAECOM, Night Vision Lab, FtBelvoir, ATTN: AMSEL-^NV-SD 
USA Computer Sys Cptd, Ft Belvoir, ATTN: Tech Library 
USAMERDC, Ft Belvoir; ATTN- STSFB-DQ 

USA'Eng Sch, Ft Belvoir, ATTN: Library \ 
USA Topographic Lab, Ft Belvoir, ATTN : ETL-TD-S 
USA Topographic Lab, Ft Belvoir, ATTN: STI.NFO Center 
USA Topographic Lab, Ft Belvoir, ATTN: ETL—GSL 
USA Intelligence Ctr & Sch, Ft Huachuca, ATTN: CTD-MS 
USA lntelligence"Ctr fit Sch, Ft Huachuca, ATTN: ATS-CTD-MS 
USA Intelligence Ctr & Sch, Ft Huarhuca, ATTN: ATSI-TE y 
USA Intelligence Ctr & Sch, Ft Huachuca. ATTN: ATSI-TEX-GS 
USA Intelligence Ctr & Sch, Ft Huachuca, ATTN: ATSI-CTS-OR 
USA Intelligence Ctr & Sch, Ft Huachuca, ATTN: ATSI-CTD-DT 
USA Intelligence Ctr & ScH, Ft Huachuca, ATTN: ATSl-CTO-CS 
USA intelligence Ctr & Sch, Ft Huachuca, ATTN: DAS/SRD 
USA Intelligence Ctr & Sch, Ft Huachuca. ATTN: ATSI-TEM 
USA Intelligence Ctr & Sch, Ft Huachuca, ATTN: Library 
CDR, HQ Ft Huachuca, ATTN: Tech Ref Div 
COH. USA Electronic grvg Grd, ATTN: STEEP-MT-S 
CDR, Prdject MASSTER, ATTN: Tech Info Center 
Hq MASSTER, USATRADOC, LNO 
Research Institute, HQ MASSTER, Ft Hood ^ 
.USA Recruiting Cmd, Ft Sherdlan, ATTN: USARCPM-P 
Senior Army Adv., USAFAGODH'AC, Elgin AF Aux Fid No. 9 
HQ USARPAC, DCSPER, APO SF 96558, ATTN: GPPf -SE 
Stimson Lib, Academy of Health Sdences, Ft Sam Houston 
Marine Corps Inst.. ATTN: Dean-MCr • . y 

HQUSMC, Commandant, ATTN: Code MTMT 51 
HQUSMC,,Commandant„ATTN: Coite MPI-20 

USC6 Academy, New London, ATTN: Admission . ^. ^ 

USCG Academy, Now Londpn, ATTN; Library 
USCG Training Ctr. NY, ATTN: CO 
USCG Training Ctr. NY. ATTN: Educ Svc Ofc 
USCG, Psychol Res Br. DC, ATTN: GP t/62 
HQ Mid-Range Br, MC Det, Quahtico,' ATTN: P&S Div 
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1 US Marine (>>rps Uaisi6(^t<r/AMC. ASexflndria^ ATTN: AMCGS-F 
"1 USAThAOOC. Ft Monroe\ATTN: ATRO-ED 
6 USATRADOC, Ft MonrcM!, /UTN: ATPR-AD 
*1 USATRAOdc; Ft Monroe, ATTN: ATT%-EA 
LISA Forces Cmd. McPhersoV ATTN: Library 
USA Aviation Test Bd. Ft RuckeVATTN; STEB.G-PO 
USA Agcy for Aviation Safoty. Ft i^ucker, ATTN: Library 
USA Agcy for Aviation Safety, Ft Rocker, ATTN: Educ Advisor 
USA Aviation Sch, Ft Rucker, ATTnN^O Dravw O 

1 KQUSA Aviation Sy> Cmd. St Louis. ATTN: AMSAV-ZDR 

2 USA Aviation 9yi T^t Act., Edvirards AFSL ATTN: SAVTE-T 
.USA Air Def Sch. Ft Bliss. ATTN: AT^tI™ 

USA Air Mobility Rsch & Dev Lab, Moffett P^, ATTf4: SAVDL-AS* 
USA Aviation Sch, Res Tng Mgt, Ft Rucker, ATTN:jATJ5T-*r-RTM 
USA AvIatJoh Sch, CO,_Ft Rucker, ATTN: AJST^D-A 
HQ. DARCOM, Alexandria, ATTN: AMXCD~t\ 
HQ. DARCOM, Alexandria/ ATTN: CDR 
US Military Academy, West Point, ATTN: Serials Unit 
US Military Academy, yVest Point, ATTN: Ofc of MHt L'^rshp 
1 US Military Academy, West Point, ATTN: M AOR 
1 USA Standardrzation Gp, UK, FPO^NY, ATTN: MASE-G6 
Ofc of Naval Rsch, Arlington, ATTN: Code 452 
Ofc of Naval Rjch, Arlington, ATTN: Code 458 
Ofc of Naval Rsch, Arlington. ATTN: Code 450 
Ofc of Naval Rsch, Arlington, ATTN: Code 441 
Naval Aerospc'Med Res Lab. Pensacola, ATTN: Acpus Sch Div 
Naval Aerospc Med Res Lab, Pensacola. ATTN: Code LSI 
Naval Aerofpc Med Res Lab, Pensacola," ATTN: Code L5 
Chief of NavPers, ATTN: Pers OR J . 

N AVAt RSTA, Klorfolk. ATTN: Safety Ctr \ 
Nav Oceanographic. DC, ATTN: Code 6251. Charts & Tech 
Center of Navat Anai, ATTN; Doc Ctr 
NavAirSysCom, ATTN: AIR-5313C 
Nav BuMed, ATTN: 713 
NavHeltcopterSubSc^ua 2, FPO SF 96601 
AFHRL (FT) WJItiam AFB 
AFHRL (TT) LovwTv ArB 
AFHRL (AS) WPAFB, OH 
AFHRL (DOJZ) Brooks AFB 
. AFHRL {DOJN) Lackland AFB 
HeUSAF (INYSD) 

HQUSAF (DPXXA) ' ' . 

AFVTG (RD) Randolph AFB 

aVvJRL (HE) WPAFB, OH * * - 



AF Inst of Tech, WPAFB, OH, ATTN: ENc/SL 



ATC (XPTD> Randolph AFB / 

USAF AeroMed Lib, Brooks AFB ISUL-4), ATTN: DOC SEC 
AFOSR (NL), Arlington 
. 1 AF Log Cmd, McClellan AFB, ATTN: ALC/DPCRB 
1 Atr f^orcc Academy, CO, ATTN: Dept of Bel Sen - 
5 Nav^ers & Dev Ctr, San Diego 
^2 Navy Med Neuropsychiatric Rsch Unit, San Diego 
1 Nav Electronic Lab, San '"?*»go, ATTN: Res Lab ^ 
1 Nav TrngCeh, San Diego, ATTN: Code 9000-Lib, 
1 NavPostGraSch, Monterey, ATTN: Code 55Aa 
t NavPostGraSch, Monterey, ATTN: C(>oe 21 24 
1 NavTmgEquipCtr, Orlando, ATTN: Tech Lib 
1 US Dept of Labor, DC, ATTN: Manpower Admin 
1 US Dept of Justice, DC, ATTN: Drug EnforceAdmin 
1 Nat Bur of Standards, DC, ATTN : Computer Info Section 
1 Nat Clearing House for MH— lnfb« Rockvitle 
1 Denver Federal Ctr, Lakewood^ ATTN: BLM 
12 Defense Documentation Center ^^ 
A Dir Psych, Army Hq, Russell Ofcs. Canberra 
1 Scientific Advsr. Mil Bd. Army Hq. Russell Ofcs. Canberra 
, 1 Mil and Air Attache, Austrian Ernbatsy 

1 Centre de Recherche Des Factours. Humaine de fa Defense 
' Nationale, Brussels 

2 Canadian Joint Staff Washington ' 
' 1 C/Air Staff, Royal Canadian A F; ATTN: Pers Std Anal Br 
3, Chief, Canadian Oef Rsch Staff , ATTN: C/CRDS(W) 
4 British Def Staff, British Embassy, Washington / 



1 Def & Civil Inst of Enviro Medicine, Canada 

1 AIR CRESS; Kensington, ATTN: Info Sy^ Br 

1 MIIItaerpsYkologlsk T]en^sta, Copehagen 

1, Military Attadw, Franch^mbassy, ATTN: Doc Sec 

1 Medectn Chef, C.CR.P.A.-Arsenal, Toulon/Naval France 

*t Prin Scientific Off, AppI Hum Engr R«ch Div, Ministry \ 
of Defense, New Delhi \ 

■ 1 Pers RKh Ofc Library, AKA, Israel Defense Force? 
1 MInlsteris van Defensie, DOOP/KL Afd Spciaal , 
Psychologlflche Zakan, The Hague, Netherlands 
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